Practical Vertical Federated Learning with Unsupervised Representation Learning
نویسندگان
چکیده
As societal concerns on data privacy recently increase, we have witnessed silos among multiple parties in various applications. Federated learning emerges as a new paradigm that enables to collaboratively train machine model without sharing their raw data. Vertical federated learning, where each party owns different features of the same set samples and only single has label, is an important challenging topic learning. Communication costs been major hurdle for practical vertical systems. In this paper, propose novel communication-efficient algorithm named FedOnce, which requires one-shot communication parties. To improve accuracy provide guarantee, FedOnce unsupervised representations setting privacy-preserving techniques based moments accountant. The comprehensive experiments 10 datasets demonstrate achieves close performance compared state-of-the-art algorithms with much lower costs. Meanwhile, our technique significantly outperforms approaches under budget.
منابع مشابه
Unsupervised Model-Free Representation Learning
Numerous control and learning problems face the situation where sequences of high-dimensional highly dependent data are available, but no or little feedback is provided to the learner. To address this issue, we formulate the following problem. Given a series of observations X0, . . . , Xn coming from a large (high-dimensional) space X , find a representation function f mapping X to a finite spa...
متن کاملDeep Unsupervised Domain Adaptation for Image Classification via Low Rank Representation Learning
Domain adaptation is a powerful technique given a wide amount of labeled data from similar attributes in different domains. In real-world applications, there is a huge number of data but almost more of them are unlabeled. It is effective in image classification where it is expensive and time-consuming to obtain adequate label data. We propose a novel method named DALRRL, which consists of deep ...
متن کاملHigh-Dimensional Unsupervised Active Learning Method
In this work, a hierarchical ensemble of projected clustering algorithm for high-dimensional data is proposed. The basic concept of the algorithm is based on the active learning method (ALM) which is a fuzzy learning scheme, inspired by some behavioral features of human brain functionality. High-dimensional unsupervised active learning method (HUALM) is a clustering algorithm which blurs the da...
متن کاملUnsupervised Representation Learning by Predicting Image Rotations
Over the last years, deep convolutional neural networks (ConvNets) have transformed the field of computer vision thanks to their unparalleled capacity to learn high level semantic image features. However, in order to successfully learn those features, they usually require massive amounts of manually labeled data, which is both expensive and impractical to scale. Therefore, unsupervised semantic...
متن کاملUnsupervised Cross-Domain Word Representation Learning
Meaning of a word varies from one domain to another. Despite this important domain dependence in word semantics, existing word representation learning methods are bound to a single domain. Given a pair of source-target domains, we propose an unsupervised method for learning domain-specific word representations that accurately capture the domainspecific aspects of word semantics. First, we selec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Big Data
سال: 2022
ISSN: ['2372-2096', '2332-7790']
DOI: https://doi.org/10.1109/tbdata.2022.3180117